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^® (57) Abstract: Products and processes for providing tactile sensations to input devices (2) or electronic devices are provided. Input 
^ devices include mechanical input devices (such as, for example, mechanical switches) and non-mechanical input devices (such as, for 
^ example, touchpads). Tactile feedback is provided by using an actuator (6) or other means in communication with the input device 
* (2) or electronic device. A controller (9) may be employed to receive signals from the input devices and control the actuator. Tactile 
feedback to an input device or electronic device may be provided in response to one or more events or situations. Such an event or 
situation may be any one designated. Examples of such events and situations include the level of pressure placed on an input device; 
the availability or lack of availability of a function associated with an input device (2); and the function, menu, or mode or operation 
^ associated with an input device's activation. A variety of feedback types and combinations may be selected. 
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METHOD AND APPARATUS FOR PROVIDING 

« 

TACTILE SENSATIONS 

RELATED APPLICATIONS 

This application claims priority to U.S. Provisional Application No. 60/335,493, 
filed November 1, 2001, and U.S. Provisional Application No. 60/399,883 filed July 31, 
2002. The entire disclosure of both applications are incorporated herein by reference. 
FIELD OF THE INVENTION 

* 

The present invention relates to methods and apparatus for providing tactile 
sensations. 
BACKGROUND 

Conventional electronic devices, such as mobile telephones and Personal Digital 
Assistants (PDAs), include visual displays. A user of such devices interacts with the 

* 

visual display using any one of a number of input devices. Examples of such input 
devices include computer mice, joysticks, trackballs, steering wheels, stylus, tablets, 
pressure-sensitive spheres, scroll wheels, keyboards, and keypads. The user provides 
instructions, responses, and other input to the device using such input devices. 

In conventional mobile telephones and PDAs, confirmation of the input provided 
by the user is primarily limited to visual or audible confirmation. In some such devices, 
physical feedback is provided by conventional mechanical switches in the form of the 
conventional mechanical feedback of switches, for example the switch closure force- 
displacement profile. Typically, in such devices, the mechanical feedback provided by 
each button is identical. In addition, in such conventional devices, for those buttons that 
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serve multiple functions, the mechanical feedback generally remains the same regardless 

of the current function of the button. 

In addition to providing extremely limited and rudimentary mechanical 
confirmation of button selection, conventional buttons as used, for example, in keypads 
for mobile telephones and PDAs, provide simple passive touch cues regarding the 
alignment of keys. Such cues include raised bumps on the center key of a telephone 
keypad or on the "F" and "G" keys of a keyboard that assist a user in orienting to the 
pattern of keys in the keypad and keyboard. Again, these physical queues are very 
limited, and users typically need to view a keypad or keypad for visual confirmation that 
the correct instructions or information is being entered. 

When a flat surface interface device is used, such as a touchpad for a computer or 
PDA, these simple mechanical cues are unavailable to the user. Often, touchpads are 
combined with flat-panel display screens that display one or more graphically generated 
buttons or softkeys. Normally, the softkeys are visible through the touchpad. A user's 
contact with the touchpad in an area defined by a softkey provides the electronic device 
having the touchpad with the input associated with that softkey. 

The use of electronic devices using such conventional mechanical buttons and 
touchpad arrangements are particularly difficult to use in distracting environments or 
when the user is attempting to perform another task simultaneously with using the 
electronic device. For example, if the other task involves operating a motor vehicle or 
heavy machinery, it may be difficult or impossible for a user to simultaneously use such 
an electronic device because such devices typically require the user to look at the device, 
at least briefly, when interacting with the device. In addition, electronic devices relying 
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on softkeys can be difficult to read in bright light environments such as in bright sunlight 
and can contain very small fonts and graphics that are difficult to read and select. 

Some conventional touchpads include vibratory feedback to the user of the 
touchpad. U.S. Patent No. 5,977,867 is one example. Such conventional systems and 
methods are limited, though. They lack a full range of functionality assistance to a user 
interacting with an electronic device. Moreover, such systems and methods still require 
considerable visual attention from the user. 
SUMMARY OF THE INVENTION 

The present invention comprises products and processes for providing tactile 
sensations to input devices or electronic devices. Input devices include mechanical input 
devices (such as, for example, mechanical switches) and non-mechanical input devices 
(such as, for example, touchpads). Tactile feedback is provided by using an actuator or 
other means in communication with the input device or electronic device. A controller 
may be employed to receive signals from the input devices and to control the actuator. 
Tactile feedback to an input device or electronic device may be provided in response to 
one or more events or situations. Such an event or situation may be any one designated. 
Examples of such events and situations include the level of pressure placed on an input 
device; the availability or lack of availability of a function associated with an input 

■ 

device; and the function, menu, or mode of operation associated with an input device's 
activation. A variety of feedback types and combinations may be selected. Mobile 
telephones and PDAs benefit from employing such products and processes, but other 
devices benefit as well. The advantages offered by the various embodiments of the 
present invention may be understood by examining this specification. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a perspective view of an embodiment of an apparatus according to the 

present invention; 

Figure 2 is a plan view of another embodiment of an apparatus according to the 
present invention; 

Figure 3 is a plan view of an electronic device including an embodiment of the 
present invention; 

Figure 4 is a schematic representations through line 4-4 of Figure 3; 
Figure 5 is a plan view of another electronic device including another 
embodiment of the present invention; 

Figure 6 is a schematic representations through line 6-6 of Figure 5; 

Figure 7 is a block diagram illustrating an embodiment of the apparatus in an 

9 

electronic device; 

Figure 8 is a flow chart illustrating a method according to the present invention; 
Figure 9 is a table illustrating a first set of data to be used in one embodiment of 
the present invention; and 

Figure 10 is a table illustrating a second set of data to be used in another 
embodiment of the present invention. 

Figure 11 is a plan view of another embodiment of the present invention. 



4 



WO 03/038800 



PCTYUS02/35016 



DETAILED DESCRIPTION 

The present invention includes methods and systems for providing tactile 
sensations. One embodiment includes methods and systems for providing tactile 
sensations to input devices, both mechanical and non-mechanical (for example soft-keys 
that are computer generated and displayed on a screen). Embodiments of the present 
invention can be utilized in wide variety of electronic devices including telephones, 
mobile telephones, remote controls, gamepads, joystick handles, automotive controls 
(radios, Compact Disc (CD) players, automobile functions, etc.), consumer electronics 
devices, Personal Digital Assistants (PDAs), personal computers, laptop computers, 
portable gaming devices, pagers, I-pagers, audio equipment, televisions, security or alarm 
systems, Automated Teller Machines (ATM), calculators, home appliances, and white 
goods. 

Figure 1 shows one embodiment of the present invention. The apparatus 1 shown 
in Figure 1 includes an input device 2 having multiple positions for communicating a 
plurality of input signals. The input device 2 can be any device capable of transmitting 
an input signal. In the embodiment shown, the input device 2 is a rocker-type switch. 
The rocker switch 2 shown can pivot or rock between two positions in which the rocker 
switch contacts and activates one of two rubber switches 3 containing conductive pads. 
The use of rubber switches 3 provides the advantage of allowing the user to still feel a 
substantial vibration or force through the input device 2 when the user had fully 
depressed the switch. Suitable rubber switches are available and known in the art. In 
other embodiments, the input device may include an analog switch, a force sending 
resistor, a strain gauge based sensor, a capacitative touch switch, a scroll wheel, a mini- 
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joystick, a touchpad, a touch screen, a 3-way switch, a 4-way switch, a 5-way switch, or 
other input device. Each position of the input device 2 corresponds to one of the input 
signals. 

The input device 2 and rubber switches 3 are mounted on a Printed Circuit Board 
(PCB) 4 in the embodiment shown to facilitate electrical communication between the 
input device 2 and an electronic device (not shown). The PCB 4 can be custom shaped 
according to the device into which the apparatus 1 is placed The PCB 4 also provides 
for secure mounting within the device by including, for example; a plurality of holes 5 to 
accept fasteners for securing to the electronic device, hi another embodiment, the input 
device 2 can be directly connected or mounted in the electronic device. 

The apparatus 1 shown in Figure 1 also includes a vibrotactile actuator 6 in 
communication with the input device 2. Preferably, the actuator 6 is configured to output 
a plurality of distinct tactile feedback sensations to the input device 2. Suitable tactile 
sensations include vibrations, for example, jolts and textures, and a plurality of distinct 
tactile sensations can be created by varying the frequency, amplitude and waveform 
output by the actuator 6. The actuator 6 is selected to deliver the desired tactile 
sensations to the input device 2 The actuator 6 shown in Figure 1 is a voice coil actuator. 
Other suitable actuators include, for example, piezo-electric actuators, eccentric mass 
actuators, moving magnet actuators, and friction brakes in contact with metal shafts. In 
addition, the actuator can include a flexure, for example an arrangement of flexible 
material, couple to the rotating shaft of a DC motor or step motor to transform the 
rotation of the motor shaft into vibrations or other haptic sensations. Various 
arrangements of a flexure coupled to a motor may be used as an actuator. For example, 
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U.S. Patent Application No. 09/585,741, filed June 2, 2000, illustrates suitable 
arrangements of flexures and motors for use as an actuator in embodiments of the present 
invention. The entire disclosure of the application No. 09/585,741 is incorporated herein 
by reference. Moreover, the application No. 09/585,741 is appended hereto as part of the 
present application, as Appendix A. Tactile sensations can also be delivered to the input 
device 2 from a speaker included with an electronic device into which the apparatus is 
placed, for example the speaker in a mobile telephone or in a personal computer. 

Although the embodiment shown in Fig. 1 includes one input device 2 and one 
actuator 6, other embodiments include a plurality of input devices, all in communication 
with a single actuator. Alternatively, an embodiment can include a plurality of actuators 
each in communication with at least one input device. Various arrangements of actuators 
in combination with input devices are suitable for use in the present invention. For 
example, U.S. Patent Application No. 09/263,263, filed July 26, 2001, published on 
March 21, 2002, as U.S. Patent Pub. No. US2002/0033795 illustrates actuators in 
combination with input devices that may be used in embodiments of the present 
invention. The entire disclosure of application No. 09/263,263, Pub. No. 2002/0033795 is 
incorporated herein by reference. Moreover, the application No. 09/263,263, Pub. No. 
2002/0033795 is appended hereto as part of the present application, as Appendix B. 

As mentioned, the actuator 6 is in communication with the input device 2. In the 
embodiment shown in Figure 1, the actuator 6 is in communication with the input device 
2 through a cantilevered beam or lever arms 7 attached to the pivoting rocker, amplifying 
the effective forces of the actuator 6 felt by the user. The tactile sensations generated by 
the actuator 6 propagate through the lever aim 7 to the input device 2. Suitable materials 
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for the lever ami 7 are capable of transmitting the tactile sensations and can be, for 

♦ 

example, metal. The lever arm 7 shown includes one or more bends 8 to fit within the 
electronic device in which the apparatus 1 is disposed Different shapes of bends may be 
used to fit within the electronic device. In another embodiment, the actuator 6 is 
mounted directly to the input device 2 or to any component of the input device. 
Alternatively, the actuator 6 is mounted to the PCB 4 to which the input device is 
attached, communicating tactile sensations to the input device through the PCB. In 
another embodiment, the actuator is an existing eccentric mass motor as is used, for 
example, as a vibrating ringer in a pager or mobile telephone. 

The vibrotactile actuator 6 can also be mounted to a portion of the case or housing 
of the electronic device in which the apparatus 1 is disposed, communicating the tactile 
sensations to the entire electronic device. In one embodiment, two actuators can be 
incorporated in the case or back of an electronic device, for example the case of a mobile 
phone in an area that contacts the user's hand. This arrangement effectively doubles the 
amplitude of the tactile sensation, and the user's fingers do not tend to attenuate the 
tactile sensation. 

The apparatus 1 also includes a controller 9 in communication with the input 
device 2 to receive the input signals therefrom. The controller 9 can also receive 
additional information from the input device 2 including the position of the input device 2 
and the amount of pressure applied to the input device 2. In one embodiment, the input 
signal includes information related to the amount of pressure applied to the input device 
2, information related to the position of the input device 2, or a combination of 
information about pressure and position. In addition to being in communication with the 
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input device 2, the controller 9 is in communication with the actuator 6 to produce a 
tactile sensation in the actuator 6 corresponding to the input or input signal received by 
the controller 9 from the input device 2. 

The controller 9 is located in a suitable location according to the needs of the 
device in which the apparatus 1 is placed. In one embodiment, the controller 9 is 
attached to the PCB 4 as shown in Figure 1. Suitable controllers, include, for example, 
digital logical processors capable of processing input, execute algorithms, and generate 
output as necessary to created the desired tactile sensations in the input device in 
response to the inputs received from that input device. Such controllers may include a 
microprocessor, an Application Specific Integrated Circuit (ASIC), and state machines. 
Such controllers include, or may be in communication with, media, for example 
computer readable media, which stores instructions that, when executed by the controller, 
cause the controller to perform the steps described herein as carried out, or assisted, by a 
controller. On embodiments of a suitable computer-readable medium includes an 
electronic, optical, magnetic, or other storage or transmission device capable of providing 
a processor, such as the processor in a web server, with computer-readable instructions. 
Other examples of suitable media include, but are not limited to, a floppy disk, CD-ROM, 
magnetic disk, memory chip, ROM, RAM, ASIC, configured processor, all optical 
media, all magnetic tape or other magnetic media, or any olber medium from which a 
computer processor can read. Also, varipus other forms of computer-readable media may 
transmit or carry instructions to a computer, including a router, private or public network, 
or other transmission device or channel. 
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In one embodiment, the apparatus 1 includes a dedicated controller 9 for use 



specifically with the apparatus 1 . This embodiment is particularly well suited for 
applications where the apparatus 1 is retro-fitted into an existing electrical or electronic 
device. In another embodiment, the controller 9 is the microprocessor or Central 
Processing Unit (CPU) of the electronic device in which the apparatus 1 is disposed. The 
apparatus 1 can also include additional circuitry such as the drive circuitry (not shown) 
necessary to create the tactile sensations in the actuator 6 in response to input from the 
controller 9 and a memory medium for storing data to be accessed by the controller 9 for 
example a correlation between the tactile sensations to be produced in the actuator 6 and 
the input information or input signal received from the input device 2. 

Figure 2 shows another embodiment of the present invention. An apparatus 60 
shown in Figure 2 includes multiple input devices. These multiple input devices include 
twelve fixed or pre-assigned alphanumeric input buttons 10a-l, three pre-assigned 
function buttons 1 la-c, and three assignable function buttons 12a-c. The plurality of 
inputs devices are arranged according to the electronic device in which the apparatus 60is 
situated. In the embodiment shown, the plurality of input devices are arranged as the 
keys in a key pad for a telephone or mobile telephone. 

Embodiments of the present invention include an input device having a means for 
detennining or sensing pressure. The input device is capable of resolving multiple levels 
of pressure placed on the input device, and of transmitting a signal associated with the 
level of pressure placed on the input device. These multiple levels of pressure may be 
defined by, for example, the physical location of, or distance traveled by, a switch-type 
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input device in the x-plane when pressed by a user (higher / lower), the magnitude of 
pressure placed on a touchpad-type input device, or other means. 

The buttons of Figure 2 are illustrative of such an embodiment. Each of the 
alphanumeric input buttons 10 shown in Figure 2 is a keypad button. Each of the buttons 
10 is capable of resolving multiple levels of pressure placed on the buttons 10. For 
example, the button 1 Oi (corresponding to the number 9 on the keypad) is capable of 
resolving five levels of pressure placed on the button lOi. In the embodiment shown, the 
first level is a state in which no pressure is placed on the button by a user, the second 
level being a first magnitude of pressure placed on the button (greater than no pressure 
placed by the user), the third level being a second magnitude of pressure placed on the 
button (where the second magnitude of pressure is different from or greater than the first 
magnitude), the fourth level being a third magnitude of pressure placed on the button 
(where the third magnitude is different from or greater than the second magnitude), and 
the fifth level being a fourth magnitude of pressure placed on the button (where the fourth 
magnitude is different from or greater than the third). 

In button lOi, each of levels two through five is associated with a distinct input 
signal. When the button lOi is in its first state, then the button 1 Oi does not transmit an 
input signal. When pressure is applied to the button lOi by a user that exceeds the first 

m 

magnitude of pressure, the button lOi transmits a first signal to the controller 9. When 
greater pressure is applied to the button lOi that exceeds the second magnitude of 
pressure, the button lOi transmits a second signal to the controller. When still greater 
pressure is applied to the button 1 Oi that exceeds the third magnitude of pressure, the 
button lOi transmits a third signal to the controller. When even greater pressure is 
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applied to the button 1 Oi that exceeds the fourth magnitude of pressure, the button 10i 
transmits a fourth signal to the controller . The structural arrangement of the 
communication by the button lOi to the controller 6 of an input signal is further 

illustrated in Fig. 4, described below. 

Each of the levels two through five of button lOi (and thus each of their 
associated signals) is associated with a letter, W-Z. The second level is associated with 
the letter W, the third level is associated with the letter X, and so on. The second level is 
associated with the letter W, the third level is associated with the letter X, and so on. In 
the embodiment shown, the key lOi has five positions corresponding to no pressure, and 
the letters W, X, Y, and Z. In an alternative embodiment, the key lOi has six positions 
corresponding to no pressure, the number "9," and the letters W, X, Y, and Z. 

m the embodiment shown, the alphanumeric buttons 10 are all capable of 
resolving five levels of pressure. In alternative embodiments, the various buttons are 
capable of resolving differing levels of pressure. For example, in an alternative 
embodiment, while the button lOi is capable of resolving five levels of pressure, the 
button 10b (corresponding to the number 2 on the keypad) is capable of resolving four 
levels of pressure placed on the button 10b (the first level being no pressure placed on the 
button). like button lOi, the levels resolved by button 10b in the alternative embodiment 
are each associated with a distinct input signal, and are each associated with a distinct 

letter of the alphabet, A-C. 

The pre-assigned function buttons 1 la-c of the apparatus 1 are keypad push 
buttons. Each of the buttons 1 la-c is capable of resolving three levels of pressure placed 
on the buttons lla-c - no pressure, a first magnitude of pressure (greater than none), and 
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a second magnitude of pressure (greater than the first magnitude). Examples of functions 
carried out by such pre-assigned function buttons 1 1 a-c include "Send" 1 la, "Power" 
lib, and "End Call" 11c. 

In the embodiment shown, each of the pre-assigned function buttons 1 1 a-c is 
configured such that the first magnitude of pressure is an amount of pressure that 
signifies that a user's finger is "hovering" over, or touching with more than passing force, 
the button. Each is also configured such that the second magnitude of pressure is an 
amount of pressure that signifies that a user's finger applies when the user wishes to 
activate the button. 

Thus, in the embodiment shown, when a user's finger "hovers" over the "Send" 
button 1 1c, a first signal is transmitted by the button 1 lc to the controller. And, when a 
user's finger activates the "Send" button 1 lc, a second signal is transmitted by the button 
1 lc to the controller. 

The assignable-function buttons 12a, 12b, 12c are buttons whose function 
depends upon the mode of operation of the device with which the apparatus 1 is 
associated. For example, when such an apparatus 1 is associated with a mobile 
telephone, such buttons 12a, 12b, 12c may be used to navigate the menus displayed to 
carry out various functions, such as scrolling through an address book, selecting a 
number to dial, editing a number, re-setting the time displayed, and similar functions. 
In addition, the assignable-function buttons 12a-c are configured similarly to the pre-' 
assigned buttons 1 la, 1 lb, 1 lc, in that the buttons 12a, 12b are configured such that the 
first magnitude of pressure is an amount of pressure that signifies that a user's finger is 
"hovering" over, or touching with more than passing force, the button, and such that the 
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second magnitude of pressure is an amount of pressure that signifies that a user's finger 
applies when the user wishes to activate the button. Preferably, the buttons Ua, 1 lb, 11c, 
12a, 12b, 12c are configured such that they receive and analyze other data in determining 
whether the user is merely hovering or, instead, wishes to activate the button (such as 
type of, and duration of, contact with the button). Any suitable input-device may be used 
an an assignable-function input device. Examples of such input-devices include rocker- 
switches and scroll wheels. 

In an alternative embodiment (not shown), the middle assignable-function button 
12c, includes the input device of Fig. 1 . It is in communication with the actuator 6 (not 
shown) shown in Fig 1 as well, and operates in the manner described with reference to 
Fig. 1 . In such an embodiment, the PCB 62 is separated at line 62a, such that the PCB4 
of Fig. 1 is not in contact with PCB62. 

Referring again to Fig. 2, although in Ihe embodiment shown there the 
alphanumeric keys have four or five available states (embodying an alphanumeric- 
character selection), and the pre-assigned buttons 11a, lib, 11c, and the assignable- • 
function buttons 12a, 12b, 12c are configured to indicate hover / activation signals, in 
other embodiments, other configurations may be used. Moreover, although the 
alphanumeric keys 10 have four or five available states, thus allowing mem to be 
associated with three or four (or more) input signals, such keys 10 may be configured to 
provide input signals at, for example, only two of the states. In this way, such keys 10 
may be configured to provide hover / activation signals similar to that which is provided 
in the pre-assigned buttons 11a, lib, 11c, and assignable-function buttons 12a, 12b, 12c 
in the embodiment shown in Fig. 2. 
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Moreover, in the embodiment shown, the levels for the alphanumeric input 
devices 10 correspond to magnitudes of pressure, but in other embodiments the levels 
resolved can be type of touch, magnitude, physical position of the switch and other 
attributes of contact with the button, or some combination thereof. The input signals 
provided by such input devices may be configured accordingly. 

In the embodiment shown in Fig, 1, the input signals that are transmitted by the 
input devices are transmitted to a controller 9. In the embodiment shown, the controller 
is in communication with storage memory (not shown). Examples of such memory 
includes Read Only Memory (ROM). The storage memory includes a table in which 
input signals are associated with various haptic feedback signals. This is explained more 
fully in relation to Figures 9-10. 

The apparatus 1 shown in Fig. 2 also includes an actuator 61. The actuator 61 is 
shown in representative fashion in Fig. 2, and not to scale or in physical placement An 
alternate actuator 61 and physical placement of the actuator 61 is shown in Fig. 4. The 
actuator 61 is in communication with the various input devices, and is configured to 
provide vibrations of varying frequencies, magnitudes, and wave-forms to the input 
devices. The actuator 61 is also in communication with the controller 9. Further 
description of embodiments of such communication and configuration is provided below. 

In the embodiment shown, the controller 9 receives an input signal from one of 
the input devices. The controller 9 then analyzes the input signal received to determine a 
signal to transmit to the actuator 61, 

For example, the controller 9 of Fig. 2 is configured such that when the controller 
9 receives a signal associated with the second level from button lOi (the "9" key), the 
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controller 9 sends a first control output signal to the actuator, and when the controller 
receives a signal associated with the third level from the button lOi, the controller sends a 
second control output signal to the actuator 61, and so on. The first control output signal 
is one that causes the actuator to provide a vibration of a certain, first frequency. The 
second control output signal is one that causes the actuator to provide a vibration of a 
certain, higher frequency, and so on. In other embodiments, the vibrations provided may 
be of the same frequency. 

Fig. 3 shows another embodiment of the present invention, in the form of a 
mobile telephone 14 having the apparatus of Fig. 2. The controller 9, actuator 61, and the 
PCB 62 of the apparatus 60 of Fig. 2 are encased in a case 18 of the mobile telephone 14. 
The mobile telephone 14 also includes a display screen 15 capable of displaying graphic 
objects 16 and alpha-numeric information 17. The alpha-numeric information 17 that 
may be displayed includes phone numbers and lists, for example of list of entries in a 
phone book, that are input by the alpha-numeric input buttons 10 and accessed by the 
assignable function buttons 12a-12c. 

Fig. 4 is a schematic representation through line 4-4 of Fig. 3 illustrating that the 
alpha-numeric input buttons or keys 10 in the mobile telephone pass through the case 1 8 
of the mobile telephone and contact a plurality of switches 19 disposed on the PCB 62. 
The switches 19 are in communication with the controller 9 (not shown). Suitable 
switches 19 include any analog or digital switch, for example rubber switches, snap 
dome-type switches, and pressure sensitive switches. Preferably, the switches 19 are 
capable of producing distinct input signals to the controller. Even more preferably, the 
switches 19 are capable of producing such signals for two or more positions. In the 
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embodiment shown, the keys 10 contact a plurality of digital switches, each capable of 
producing four distinct input signals to the controller 9 to correspond to the four levels at 
which pressure is applied to the buttons 10 by the user. 

The PCB 62, on a side opposite the switches, is in communication with the 
actuator 61 . As illustrated, the actuator 61 is a piezo-electric actuator having a metal 
diaphragm 20 in contact with the PCB 62 through one or more spacers 21 and a piezo 
ceramic element 22 in contact with the metal diaphragm 20. Alternative actuator 

■ 

embodiments include a flexure coupled to the shaft of a motor, secured to the PCB 62. 

As illustrated, the keys 1 0 are initially in a rest position 23. A biasing member 
arrangement (not shown) as is available and understood in the art is used to hold the keys 
in the rest position 23. An object 24, for example the user's finger or a stylus, is used to 
select one or more of the keys 10 by applying pressure in the direction of arrow A. This 
pressure causes the selected key to progress through a plurality of positions. As 
illustrated, after leaving the rest position 23, the keys pass sequentially through a second 
position 25, a third position, 26, a fourth position 27, and a fifth position, 28 as greater 
and greater pressure is applied to the, button 10. The distance of travel between each 
position does not have to be equal, and the amount of pressure required to move between 
each position can vary. In addition, for a given key, the number of positions can vary 
from two (no pressure and activated) up to the number of input signals assigned to a 
given key. Therefore, in the embodiment shown, a key lOi is moveable from a first level 
(rest) 23 to a second level 25 upon the application of a sufficient amount of pressure to 
the input device. In the embodiment shown in Fig. 3, the amount of pressure necessary to 
move the key lOi from rest 23 to the second position 25 is about equal to the amount of 

17 



WO 03/038800 PCT/US02/35016 



pressure that user's finger would exert upon contact with Ihe key without actually 
selecting the key. 

Accordingly, in one method of using the embodiment shown in Fig. 3, when a 
user of the mobile telephone 14 shown in Fig. 3 presses the "9" key lOi using a relatively 
light amount of pressure, the burton lOi moves from rest state 23 to its second level 25. 
Such movement causes the button lOi to apply pressure to switch 19a, which is received 
by switch 19a. The switch 19a is in communication with the controller 9. The switch 
19a is configured to transmit a first signal to the controller 9 upon receiving a pressure of 
magnitude indicating that sufficient pressure has been placed on button lOi to move from 
its first level 23 to its second level 25. The controller 9 receives this first signal. The 
controller 9 is configured to transmit a first controller output signal to the actuator 61 



■ 

upon receipt of this first signal from the switch 19a. The controller transmits the first 
controller output signal to the actuator 61 . The actuator 61 is configured to provide a 
vibration of a first pre-selected frequency to the metal diaphragm 20 of a pre-selected 
duration upon receipt of such a first signal. In the embodiment shown, the actuator 61 
provides a side-to-side vibration to the diaphragm The diaphragm 20 thus vibrates at the 
pre-selected frequency, in turn causing the PCB 62 to vibrate at that same frequency, and 
thus in turn causing the switches 19 to vibrate at that frequency. The switch 19a is in 



coi 



lunication with the button lOi, thus causing the button lOi to vibrate at that 



frequency. 

When the user applies further pressure to the button lOi sufficient to cause the 
button to move from the second level 25 to a third level 26, the button's force is applied 
to switch 19a. Switch 19a receives the force and is configured to transmit a second signal 
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to the controller 9 whenever it receives force to indicate that the button lOi has moved 
from the second level 25 to the third level 26. The switch 19a does so, and the controller 
9 receives the second signal. The controller 9 is configured to transmit a second 
controller output signal to the actuator 61 upon receipt of this second signal from the 
switch 1 9a The controller 61 transmits the second controller output signal to the actuator 
61. The actuator 6 is configured to provide a vibration of a second pre-selected 
frequency, different from the first pre-selected frequency, for a pre-determined duration 
to the metal diaphragm 20 upon receipt of such a second signal. In other embodiments, 
the first and second pre-selected frequencies are the same. As above, the actuator 61 
provides a side-to-side vibration to the diaphragm, which is communicated through the 
PCB 62 and switches 19 to the button 10i. 

When a user applies pressure to the button lOi, which is communicated to the 
switch 19a, at each level 25, 26, 27, 28, a distinct signal is transmitted by the switch 19a 
to the controller 9. Thus, in the embodiment shown, different signals are transmitted by 
the switch 19a for each pressure-applied levels 25, 26, 27, 28. 

In the embodiment shown, a "dwell to select" function is employed. For example, 
when a user provides sufficient input to cause the button to move to its second level 25, 
the first signal is transmitted to the controller 6 continuously while the button receives 
pressure to push it at or past the second level 25 but not sufficient pressure to push the 

i 

button lOi to the third level 26. The controller 9 determines the length of time the button 
is maintained at the second level 25 by monitoring the length of time the first signal is 
transmitted to the controller 9. If the first signal is received for greater than a pre- 
determined length of time, the controller determines that the user wishes to "select" the 
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function associated with the second level 25 by Hie fact that the user "dwelled" at that 
level for the pre-determined time. Upon so determining, the controller 9 transmits a 
signal to a processor (not shown) indicating that the user has selected the function 
associated with the second level of button lOi, in this case the selection of the letter «W." 
In embodiments, the controller 9, upon so detennining, also transmits a signal to the 
actuator 61 to cause the actuator 61 to vibrate at a frequency, magnitude, and/or wave- 
form indicative of selection of the function. 

In one embodiment, in addition to providing haptic feedback to Ihe input device, 
the controller 9 also sends a signal to the display 17 to cause the alphanumeric character 
associated with the input signal to be displayed. For example, in one embodiment, upon 
detecting the presence of a first pressure (through receipt of a first input signal) and 
sufficient dweU time to indicate a selection, the controller sends a signal to the display 17 
indicating that the display should display the letter «X" Upon detecting the presence of a 
second pressure (through receipt of a second input signal) and sufficient dwell time to 
indicate a selection, the controller sends a signal to the display 17 indicating that the 
display should display the letter «Y." Upon detecting the presence of a third pressure 
(through receipt of a third input signal) and sufficient dwell time to indicate a selection, 
the controller sends a signal to the display 17 indicating that the display should display 
the letter "Z." The display 17 then displays each of these characters, X, Y, Z. 

Various other embodiments maybe employed For example, instead of having a 
single actuator to provide feedback to all input devices receiving such feedback, like the 
embodiments shown in Figs. 2-3, other embodiments have two or more actuators. These 
two or more actuators may be in communication with all or part of the input devices that 
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provide tactile feedback. The two actuators may each provide significantly different 
types of feedback to the same set of input devices, or each may be in communication with 
a different group of input devices to provide the same or different types of feedback. As 
another example, the actuator and input devices may be configured to provide vibration 
to only the button that is receiving pressure from the user, or they may be configured to 
provide vibration to all buttons or at least more buttons than the one(s) receiving pressure 
from the user. 

Moreover, although the actuator 61 is shown as disposed below the PCB 62 in 
Fig. 4, in other embodiments the actuator 61 may be disposed at other locations within 
the device having such apparatus, whether the device is a mobile telephone, PDA, or 
other device. Preferably, the actuator is disposed within the housing of the device. 
Preferably, it is communication with the PCB 62, but is placed anywhere in 
communication with the PCB 62 as the size and space restrictions of the application will 
allow. In other embodiments, the actuator 61 is located outside the housing of the device 
(such as beside it). In still other embodiments, the actuator 61 is in communication with 
the input devices other than through the PCB 62. 

In the embodiment shown, a distinct tactile sensation is produced for each of the 
various levels at each of the various keys. In other embodiments, the controller 6 selects 
one of a preselected group of sensations to provide in response to the various signals 
received by the controller. 

Fig. 5 shows another embodiment of the present invention. Referring to Fig. 5, a 
PDA 31 having an input device in the form of a pressure-sensitive touchpad 30 is shown. 
The PDA 31 also includes a plurality of mechanical type buttons 32. The PDA 31 also 



21 



WO 03/038800 



PCT/US02/35016 



includes a display panel 33 capable of displaying computer generated graphics. Suitable 
display panels include flat-panel type displays including a Liquid Crystal Display (LCD), 
plasma displays, Thin Film Transistor (TFT) type displays or other flat displays, such as 
are found in laptops and color PDA's, and conventional cathode ray tube displays. 

Fig. 6 shows a cross-sectional view of the PDA 31 of Fig. 5 along line 6-6. As is 
best displayed in Fig. 6, the display 33 is underneath the touchpad 30 and is in 
communication wifli the touchpad 30 to transmit tactile sensations thereto. The display 



33 is also in communication with an actuator 64 to receive a tactile sensation therefrom 
for communication to the touchpad 30. Other arrangements of the touchpad 30, display 
33 and actuator 64 are also possible including arrangements in which the actuator 64 is in 
direct contact with the touchpad 30. The display 33 is in communication with the 
touchpad 30 through two spacers 34. Suitable spacers are constructed of a material mat 
can transmit the tactile sensations between the display 33 and the touchpad 30. In other 



embodiments, the touchpad 30 and display 33 are in direct physical contact, and the 
touchpad 30 and display are not in communication. The tactile sensations produced in 
the touchpad 30 are transmitted to the object 24 when the object 24 is brought into 
contact with a surface 35 of the touchpad 30. 

Referring again to Fig. 5, the display 33 displays a plurality of software-generated 
buttons or keys, called softkeys 36a-i. The softkeys 36a-i provide a graphical user , 
interface for the PDA 31 and are arranged in a desired pattern or grid. Each softkey 36 
occupies a distinct location on the display panel. As illustrated, the PDA 31 canfunction 
as a mobile telephone, and the softkeys 36 are arranged as a telephone keypad to provide 
the same functionality as the mechanical keys on a conventional telephone keypad. The 
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display 33 of the PDA 31 also includes additional graphical outputs 37 and areas 38 
without graphical output. The displayed softkeys 36 are viewable through the touchpad 
30 and represent corresponding unique positions on the touchpad 30. 

An object 24, for example a human finger, selects a desired softkey 36a-i by 
contacting the touchpad 30 at the appropriate location. A controller (not shown) is in 
communication with the touchpad 30. The controller of this embodiment is similar in 
structure and functionality to the controller described in relation to the embodiment of 
Fig. 3. The controller is capable of determining the location on the display screen 33 that 
is touched by the object 24, and the softkey 36 corresponding to the touched location- 
Based upon this information, the controller causes the actuator 64 to provide a 
corresponding tactile sensation. The actuator 64 can cause vibrations in the touchpad 35 
in a direction parallel to the surface 35 of the touch paid or perpendicular to the surface 
35 of the touchpad 30* The controller also determines when an input is ambiguous, such 
as when two or more softkeys are simultaneously selected or when an area of the display 
containing no graphics 38 is touched, and causes the actuator to output an appropriate 
tactile sensation. Preferably, the same controller that controls the displayed softkeys 36 
also controls the tactile feedback sensations produced by the actuator 64. 

Certain softkeys 36b-i represent multiple positions or multiple inputs, each input 
or position corresponding to a distinct amount of pressure applied to the softkey 36b-i. 
This distinct amount of pressure is detected by the controller in communication with the 
touchpad 30, Alternatively, the apparatus can include a separate pressure calculator to 
measure the amount of pressure applied to the touchpad 30 . In the embodiment shown, 
the amount of pressure applied to the touchpad 30 is calculated by the controller based 
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upon the amount of area of the object 24 used to select the softkey that is in contact with 

the surface 35 of the touchpad 30. 

The amount of pressure applied to the input device or to the softkey 36a-i on the 
touchpad can be determined by reading or determining the size or area of the contact 
patch created by the object 24, such as the user' s finger, on the input device or softkey 
36a-i. In addition to reading the current size of the contact patch, the rate of change of 
the contact patch can also be determined, using dynamic thresholds and to look at how 
fast the user's pressure is changing. If the contact patch area changes at a sufficiently 
large rate, the controller can determine that the corresponding input device or softkey 

36a-i is being selected. 

The functionality of the softkeys shown in Fig. 5 is similar to the mechanical key 
counter parts described in relation to Figs. 2 and 3. Therefore, the pressure level of a 
selected softkey may be moveable from a first position to a second position upon the 
application of a sufficient amount of pressure. The amount of pressure necessary to 
move the softkey 36a to the second position (the first position being at rest or no contact) 
input device to the first position is about equal to the amount of pressure that user's finger 
would exert upon contact with the touchpad surface and sliding lightly along the surface, 
m this embodiment, the controller is configured to cause the actuator to produce a first 
tactile sensation when the softkey 36a is in the second position or when the applied 
pressure is less than the amount of pressure necessary to indicate that the softkey has 
been selected, that is the third positioa The controller would then cause the actuator 64 
to produce a second tactile sensation upon receipt of the input signal associated with the 
third position or upon detection of a sufficient amount of pressure applied to the softkey 
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36a. The softkey 36i has five positions associated with four distinct applied pressures 

and no pressure at the softkey 36i, and corresponding to the input signals for the letters 

■ 

W, X, Y, and Z. A dwell to select feature can be used to determine the desired position 
and associated input signal. 

This functionality facilitates a user moving an object over the various soflkeys 
displayed on the input device and receiving a specific frequency or tactile sensation to 
signal that a particular softkey has been touched. As the object 24 contacts other softkeys 
in die display matrix, additional distinct tactile sensations unique to these other soflkeys 
are produced. With continued use, the user can quickly become accustomed to the 
various distinct tactile sensations and the associations between sensations and specific 
softkeys, permitting identification and selection of softkeys or buttons by touch alone. In 
fact, distinct tactile sensations can be used with the same button regardless of the 
electronic device, creating a universal tactile sensation library similar to for example, a 
busy signal providing a universal auditory signal that a telephone number is unavailable 
regardless of the type of telephone equipment used. For example, a distinct tactile 
sensation can be played when the object is in contact with the "5" key, providing a 
'home' key indication. In addition, keys located on the center axis can have a single 
'pop* while keys in the columns to the left and right of the center axis have two 'pops', 
providing an indication of the general location of the object 24 in a keypad matrix. 

In another example, if the user is moving the object 24 over the "9" key, a 
relatively high frequency vibration can be output on all the keys. When the pressure 
associated with the object is detected at the "6" key, a lower frequency vibration can be 
output, allowing the user to determine which key is presently in contact with the object 



25 



WO 03/038800 PCT/US02/35016 

through the sense of touch. Since it is unlikely that a user would press or contact more 
than one sofikey simultaneously, a single vibrotactile actuator outputting the same 
sensation to all of the buttons simultaneously can be used. When the user applies 
increased pressure to a sofikey with the object 24 and that pressure is greater than a 
predetermined threshold pressure level, the function associated with that sofikey is 
activated. 

Fig. 7 is a block level diagram illustrating a representative embodiment of the 
present invention. The various components communicate across a common 
communication bus 39. The input devices 40 produce input signals in accordance with 
the present invention, and the input signals are communicated to the controller 41 across 
the communication bus 39. The controller 41 can also receive pressure or position 
information regarding the input devices associated with the received input signal. Based 
upon the received input signal, pressure and position data, the controller accesses a 
memory 42 to obtain the necessary data regarding the functionality and tactile feedback 
associated with the received input signal. In addition, the controller 41 can update data 
stored in the memory as for example when the input signal relates to changing the 
functionality or input options associated with the input device that produced the input 
signal. Based upon the received functionality, the controller delivers a function signal to 
the electronic device 43 to which the apparatus is connected. In addition, the controller 
41 modifies the output on the display 44 in particular where the display is part of the 
input device, such as when a touchpad is used. Alternatively, the electronic device 
controls and updates the display. In addition,* the controller can be the CPU associated 
with the electronic device, and the memory can be the memory associated with the 
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electronic device. The arrangement of the controller, memory and display depends upon 
whether or not the apparatus is constructed as a standalone device that can be retrofitted 
into an existing electronic device or is incorporated into the electronic device itself. The 
controller uses the tactile feedback information received from the memory to provide the 
necessary input to control circuitry 45 to drive the actuator 46 to produce the desired 
tactile sensation in the appropriate input device. 

Referring to Fig. 8, a flow chart illustrating a method of producing a tactile 
feedback sensation in an input device according to the present invention is illustrated. A 
controller monitors an input device in an apparatus 47. When a plurality of input devices 
are included in the apparatus, the controller can either monitor each input device 
sequentially or in parallel. Although illustrated as a single pass function, monitoring of 
the input devices is preferably handled as a continuous loop function. 

The input device, in response to user input, provides one or more input signals, 
position data, and pressure data to the controller. As the controller monitors the input 
device, it first detects whether or not an input signal is being generated by the input 
device 48. If an input signal is being generated, the controller obtains the input signal 49 
associated with the input device. The controller then detects if the same input device is 
generating any position data 50. If position data is being generated, the controller obtains 
the position data 51 associated with the input device. The controller also detects if the 
same input device is generating any pressure data 52. If pressure data is being generated, 
the controller obtains the pressure data 53 associated with the input device. The 
controller may detect and obtain the three types of data in any order. Preferably, the 
controller, while obtaining the data, maintains an association among the input device, the 
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input signal, the pressure data, and the positions data. In some embodiments, the input 
signal includes pressure data, or data from which the pressure applied to the input device 
may be calculated, position data, or a combination or pressure and position data. 

Having obtained the input data from the input device, or from a plurality of input 
devices, the controller then accesses a memory device 54 in which is stored at least one 
database containing information necessary to produce the desired function in the 
electronic device and the predetermined tactile sensation in an input device, and accesses 
this information 55. In one embodiment, this information is in the form of associations 
among the detected input data, the functions of the electronic device or apparatus, and the 
tactile sensations. An exemplars group of associations is represented in tabular form in 

* 

Fig. 9. 

As is shown in the table, for any given input device, a plurality of combinations of 
input signals, position data, and pressure data is possible, and each combination relates to 
a specified function of either the electronic device or a distinct tactile sensation. These 
combinations vary depending on the type of input device assigned to each input signal 
and the current functionality of that input device. The controller, using the data obtained 
from monitoring the input device, reads the table and obtains the associated function and 

tactile feedback information. 

Referring to Pig. 9, in one embodiment, a controller monitors input device 
number 5. On subsequent monitoring passes, the controller does not detect either an 
input signal or position data, but detects a distinct pressure, Pressure 1. Based upon the 
information in the table associated with Pressure 1, the controller obtains the associated 
function information for selecting the number "2", and information for distinct tactile 
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Sensation 13. The controller delivers the function information to the electronic device 70 
which uses that information to display the number "2" or to indicate that the number "2" 
has been selected. The controller uses the information for distinct tactile Sensation 13 to 
produce Sensation 13 in an input device 56, by for example, causing an actuator to cause 
the input device to vibrate at a frequency associated with Sensation 13. 

On a later monitoring pass, the controller detects a pressure magnitude of pressure 
3 on input device number 5. Similarly, based upon the information in the table associated 
with Pressure 3, the controller obtains the associated function information for selecting 
the letter "B" and information for distinct tactile Sensation 15. The controller delivers 
the function information to the electronic device which uses that information to display 
the letter "B" or to enter the letter "B" in a program such as a telephone keypad. 
Therefore, in response to the detection of at least two distinct pressures applied to the 
input devices, the controller has produced at least two distinct tactile sensations in the 
input device number 5. The controller can also detect a plurality of distinct pressures 
applied to input device number 5 and can produce a plurality of distinct tactile sensations 
in input device 5, each tactile sensation related to one of the plurality of distinct 
pressures. Although illustrated for a single input device, the controller can detect two 
distinct pressures for a plurality of input devices and can produce at least two distinct 
tactile sensations in each one of these input devices. In another embodiment, the 
controller can detect a plurality of distinct pressures in the plurality of input devices and 
produce a plurality of distinct tactile sensations in the plurality of input devices. The 
distinct pressures can represent either discrete pressures or a range of applied pressure. 
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In another embodiment, me controller monitors input device number 3, which is 
capable of inputting a plurality of input signals, Inputs 2A-E, to the apparatus. Each 
input signal corresponds to a distinct pressure applied to input device number 3, Pressures 
1-5. Each input signal and pressure corresponds to a distinct function and a distinct 
tactile sensation, Sensations 5-9. In one embodiment, each input signal corresponds to an 
alphanumeric character. In this embodiment, the controller delivers function information 
to the electronic device related to displaying the proper alphanumeric character on an 
output device associated with the electronic device. Alternatively, the controller can 
display the associated alphanumeric character directly on me output device. 

Referring still to Fig. 9, in another embodiment of a method according to the 
present invention, the controller monitors input device number 1 and detects a first 
pressure being applied on a first location on input device number 1. Preferably, input 
device number 1 is a touchpad input device. In one embodiment, the first pressure is a 
discrete pressure, pressure 1. In another embodiment, the first pressure represents arange 
of pressures having a value less than Pressure 1 . The function associated with the first 
applied pressure indicates that this is the pressure range associated with a user simply 
searching or feeling for the location of the desired button or key. Therefore, the 
controller does not provide a function input to the electronic device. The controller does, 

f 

however, provide a first tactile sensation, Sensation 1, to input device number 1. 

i 

The controller men detects an input signal, Input 1 and a pressure greater than or 
equal to Pressure 1 at Input 1 . In response, the controller delivers a function input 
corresponding to "Select" to the electronic device and produces a second distinct tactile 
sensation, Sensation 2, in Input Device 1 . 
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In another embodiment, the controller monitors Input Device 7 and detects a first 
pressure, Pressure 1, at a first location, Location 1 on the input device. Preferably, the 
input device is a touchpad input device. In response, the controller provides a first tactile 
sensation, Sensation 20, in Input Device 7. In addition, the controller detects a second 
pressure, Pressure 2, applied at a second location, Location 2, on Input Device 7. In 
response, the controller provides a second tactile sensation, Sensation 21 in Input Device 
7. The first pressure can correspond to a first input signal, Input 7, and a first function, 
Function 1, and the second pressure can correspond to a second input signal, Input 8, and 
a second function, Function 2. The controller delivers the associated function input to the 
electronic device in response to each received pressure. Note that the controller may 
cause the actuator to include a different wave form, frequency, and/or magnitude as 
tactile feedback in relation to different pressures, modes, menus, and other functionality. 

The controller can also determine if any an ambiguous input is received 71. The 
ambiguous input can represent a combination of input device, input signal, position data, 
and pressure data that is not represented the data contained in memory. Alternatively, an 
ambiguous input signal can represent input simultaneously from two input devices or an 
input from a portion of a touchpad that is not associated with an input device. In 
response to receiving an ambiguous input signal, the controller obtains the associated 
ambiguous tactile feedback information 72 and produces the associated distinct tactile 
sensation, Sensation 22, in one or more input devices associated with the ambiguous 
input In one embodiment, when the controller detects both a first and second input, the 
controller determines if either one of the inputs is ambiguous. If not, then the controller 
produces the associated first and second tactile sensations. If either input signal is 
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ambiguous, then the controller produces the ambiguous output tactile sensation 56 in the 

appropriate input device. 

Since the function corresponding to the input signals, positions, and pressures 
detected by the controller may involve modification of the functions associated with a 
given combination, the controller can also update the database stored in memory 57. In 
one embodiment, the controller is monitoring Input Device 6, and detects a first pressure, 
Pressure 1, applied to that input device. The first pressure corresponds to one of a 
plurality of input signals, Input 4, corresponding to a first set of input functions, 
Functions 1-3. The controller obtains Function 1 and Sensation 17 information and 
produces the appropriate tactile sensation at Input Device 6. Function 1 can represent 
one set of menus from a list of menus or one operating mode out of a plurality of 
operating modes. Suitable operating modes include instant messaging, electronic mail, 
voice mail, games, and missed phone calls. 

Since Function 1 represents a menu or mode that may have additional sub-menus 
or mode functions associated with it, the controller, in response to Function 1 updates the 
database as illustrated in Figure 10. As the controller continues to monitor Input Device 
6, it detects a second pressure 3' corresponding to one of the input signals, Input 6, which 
corresponds to one function in the second set of functions, Function 6. The controller 
also obtains the tactile sensation, Sensation 19', associated with the selected second set 
function and provides this tactile sensation at Input Device 6. In addition, the controller 
provides an associated function signal to the electronic device. Suitable second set 
functions include sub-menus and functions corresponding to the selected first set 
function. In addition, the second set functions can include a function that returns the set 
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of functions to the first set of functions. Although the pressures and tactile sensations 
associated with the first and second set of functions can be the same, preferably, the first 
pressures and tactile sensations, Pressures 1-3 and Sensations 17-19, are distinct from the 
second pressures and tactile sensations, Pressures T-3* and Sensations 17'-19\ 

In an embodiment of the apparatus of the present invention, for example, the 
apparatus is incorporated into a mobile phone and includes an assignable-function input 
device and assignable function rocker switch input device. In a main or home screen of 
the mobile telephone that is displayed upon powering up the mobile telephone, the 
assigned function for the assignable-function input device is "PHONEBOOK 5 * and the 
rocker switch has no current function assigned to it. Light searching pressure applied to 
the assignable input device and the rocker switch will produce first and second distinct 
tactile sensations to indicate which input device is being contacted Selecting the rocker 
switch will not produce any function in the mobile phone since no function is currently 
assigned and a function failure tactile sensation, as described herein, will be output 
through the rocker switch. Selecting the assignable input device will place the mobile 
telephone in "Phonebook" mode and a third distinct tactile sensation will be output 
through the assignable input device. 

A list of phonebook entries is now displayed on the screen of the mobile 
telephone. The assignable input device is assigned the function "SELECT" and the 
rocker switch is assigned a scroll function. Light pressure on the assignable input device 
or the rocker switch produce a fourth and fifth distinct tactile sensations, indicating that 
themobile phone and the input devices are in "Phonebook" mode. Selecting the rocker 
switch to either scroll up and down produces bumps or clicks associated with scrolling a 
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list of entries in the rocker switch. Special clicks can be output for passing each 
alphabetical tab in the phonebook or for passing frequently called entries. In one 
embodiment, an analog switch is included under the rocker switch to provide an analog 
signal roughly in proportion to the pressure registered on the rocker switch. This allows 
the list that is being scrolled to be scrolled at a rate that can be controllable with the 
amount of pressure applied, and which is communicated to the user by corresponding 
increase in the rate of haptic events played on me rocker switch. Once the rocker switch 
has been used to highlight the desired entry, the assignable input device is pushed to 
select that entry and a sixth distinct tactile sensation is output through the assignable 
input device. 

The assignable input device continues to be assigned Hie function of select and the 
rocker switch is still used as a scrolling device. The display of the mobile telephone, 
however, display another menu list containing the functions "EDIT", "VIEW", "CALL", 
and "DELETE". Light pressure on assignable input device and rocker switch again 
produces the fourth and fifth tactile sensations, indicating that the "Phonebook" mode or 
function is still active. Using the rocker switch to scroll up or down through the list again 
produces a click in the rocker switch as each entry is passed. The magnitude of each 
click and the spacing between clicks can be varied to indicate mat a relatively short list is 
being scrolled. In addition to a click, seventh, eighth , ninth and tenth distinct tactile 
sensations as output to the rocker switch as the switch scrolls past "EDIT", "VIEW", 
"CALL", and "DELETE" respectively. Scrolling is stopped on the "CALL" entry, and 
the assignable input device is pushed, calling the number associated with the chosen entry 
from the phonebook. In addition, the ninth tactile sensation is output to the assignable 
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input device. An attempt to active one of the functions, such as "CALL"* before the 
device is ready causes the controller to indicate that the function is available. 

Various other functions may be initiated by using the buttons. For example, in a 
mobile telephone having the functionality of instant messaging, electronic mail, voice 
mail, games, and missed call read-out, the user may select one of these functions. In an 

■ 

embodiment, a distinct tactile sensation is initiated by the controller whenever the user 
initiates one of these functions, and the distinct tactile sensation is different for each 
function. 

Regardless of the input device being monitored by the controller, upon detection 
of first and second input signals, first and second pressures or first and second positions 
and obtaining the associated first and second functions, the controller can determine if 
these functions are available for execution 58. Alternatively, the controller provides the 
necessary function signals to the electronic device which determines the availability of 
those functions. If the first and second functions are available, then the controller 
produces the associated tactile sensations in the appropriate input devices. If one of the 
first or second functions are not available then the controller obtains the tactile sensation 
information for the tactile sensation associated with function failure 59, Sensation 23, and 
produces that sensation in the appropriate input device. Examples of function failure 
include selecting the re-dial feature on a telephone when no number is stored in the re- 
dial memory, attempting to access a program or menu for which the user does not have 
authority to access, and attempting to initiate a mobile telephone call having entered an 
incomplete phone number. 
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Figure 1 1 aids in illustrating another embodiment of the present invention. In one 



a menu 



ibodiment of the present invention, a device provides haptic feedback while navigating 
structure, allowing a user to navigate the menu structure more efficiently, 
preferably without having to refer to the visual display. In such an embodiment, an 
actuator generates distinct sensations that represent various sections of the menu 
structure, specific menu options, and events that occur while navigating the menu 
structure. 

For example, in one embodiment, each of the highest level or main menu options 
corresponds to a distinct vibrotactile sensation that varies in pitch. As the user navigates 
between the main menu topics, the actuator produces a distinct number of pulses. The 
varying pitch combined with the alternating pulses provides feedback that identifies to 
the user the menu currently selected or highlighted. 

M another embodiment, the number of occurrences of a distinct vibrotactile 
sensation, such as a pop, corresponds to the index number of the menu option within a list 
of menu options. In such an embodiment, one pop signifies the first option; two pops 
signifies the second option. In yet another embodiment, a distinct vibrotactile effect 
signifies that the user is cycling from the end of a particular menu back to the beginning 
("rolling over"). 

Fig. 11 is a front view of a personal digital assistant (PDA) 100 in one such 
embodiment of the present invention. The PDA 100 includes a display 102, a plurality of 
buttons, including button 104, for executing specific functions and appUcations, and a 5- 
way directional pad (D-pad) 105 for navigation within the various interfaces displayed on 
the PDA 1 00. With the 5-way D-pad, a user clicks the directional keys to move up and 
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down and left and right through the menu structure and clicks the center of the D-pad to 
select a particular option. In the embodiment shown, the active application is displaying 
a menu structure. The menu structure 108 includes main menu topics 110. Selection of 
the main menu topics results in either the display of a sub-menu or the execution of an 
associated function or application. In the embodiment shown, selection of the File menu 
option on the main menu 110 results in the display of a sub-menu 112, As with the main 
menu options, selection of any of the topics on the sub-menu 1 12 results in either the 
display of a secondary sub-menu or the execution of an associated function or 
application. For example, selection of the Send To option on sub-menu 1 12 results in 
display of secondary sub-menu 114. 

In the embodiment shown in Figure 1 1, a user presses button 104 to activate an 
application. Within the application, the user utilizes D-pad 106 to navigate to the main 
menu 108. An actuator (not shown) as described herein, such as an eccentric rotating 
mass or voicecoil, provides a brief, distinct haptic effect as the user highlights each of the 
options in the main menu 108. The effect may change in pitch or in some other maimer 
to alert the user to the fact that the highlighted option has changed. The user may either 
click the center of the D-pad 106 to select an option or click the down arrow. Performing 
either of these actions over the File option produces sub-menu 1 12. 

The user clicks the down arrow to move through the sub-menu 1 12. In the 
embodiment shown, when a directional arrow of the D-pad 106 is held down, the menu 
options in sub-menu 1 12 scroll at a fixed rate, and a haptic effect plays with each option 
that appears below the cursor. The longer the directional arrow is held down, the faster 
the rate of scrolling. The PDA 100 communicates the rate of scrolling by a 
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corresponding change in the haptic effect, such as an increase in frequency. If the user 
clicks the right arrow when the cursor highlights the Send To option, the secondary sub- 
menu 1 14 is displayed. Navigation through the secondary sub-menu 1 14 occurs in a 
manner similar to that which occurs in sub-menu 1 12. To select an option within the 
secondary sub-menu 1 14, the user clicks the center of the D-pad 106. Clicking the center 
of the D-pad 106 triggers the playing of yet another distinct haptic effect. In addition, the 
D-pad switch 106, either a 5-way or a 4-way, can provide haptic effects indicating the 
direction that the switch was being pressed. 

The embodiment shown in Figure 1 1 is applicable to a variety of applications, 
particularly to applications that display lists. For example, in one embodiment, an 
address book containing a list of names is displayed on the PDA 100. In such an 
embodiment, the actuator plays an effect as the user scrolls through the list. Further, the 
actuator plays a distinct haptic effect as the user navigates from names starting with one 
letter, for example A, to the next letter, B. Such an embodiment may also include a 
distinct effect corresponding to names that the user has previously identified as favorites 

in the address book. 

Another embodiment of the present invention provides the user with distinct 

haptic effects corresponding to the operational mode of an electronic device. For 

example, in an embodiment utilizing a PDA, such as PDA 31 in Fig. 5, a user may 

activate one of many modes, including, for example, the phone interface shown in Fig. 5, 

the application interface shown in Fig. 1 1, an address book, email, or other modes. 

Referring to Fig. 5, in one such embodiment, the user clicks a button 32 to activate the 

phone application. When the user clicks the button, the PDA 31 displays a phone 

» 
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1 

interface 38. While the PDA 3 1 is in phone mode, the actuator provides a persistent 
haptic effect indicating to the user that the phone mode is active. In this way, the user is 
able to determine the mode of the PDA 3 1 without visually referring to it. 

Another embodiment of the present invention provides the user with distinct 
haptic effects for modes within a cell phone or other electronic device. Referring to Fig. 
3, users of cell phones, such as cell phone 14, often store a list of number that are 
frequently dialed in a memory associated with one or a combination of number keys 10, 
In such an embodiment, the user may click a function key before clicking the number key 
1 0, providing a signal to the phone 3 1 that the user will specify a number to dial by 
clicking a number key combination. In one embodiment of the present invention, when 
the user clicks the function button, the actuator provides a persistent haptic effect, 
indicating to the user that the cell phone is in the rapid-dialing mode. The haptic effect 
alerts the user to the fact that when the user selects a number-key combination, the cell 
phone will dial the phone number associated with the number-key combination in 
memory. By providing a haptic effect identifying the mode that the cell phone 3 1 is in, 
the embodiment minimizes or eliminates the user's need to refer to the cell phone 3 1 
visually. 

* 

In another embodiment of the present invention, an actuator pro vides feedback 
when an option or function is unavailable (referred to herein as "negative feedback"). In 
such an embodiment implemented in a cell phone, such as cell phone 3 1 shown in Fig. 3, 
the user is able to place calls. The user dials a combination of number keys 10 and then 
presses the send key 1 1 to execute the phone call. In an embodiment utilizing negative 
feedback, if the user enters an invalid phone number, for example, a phone number 
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including only 6 digits, the cell phone provides negative feedback, indicating that the 
send function is not available. The negative feedback may, for example, comprise a very 
low frequency buzz. In another embodiment, the actuator provides negative feedback to 
the user if the user clicks a redial button (not shown) without having previously dialed a 
number. 

Other embodiments and uses of the present invention will be apparent to those 
skilled in the art from consideration of this application and practice of the invention 
disclosed herein. The present description and examples should be considered exemplary 
only, with the true scope and spirit of the invention being indicated by the following 
claims. As will be understood by those of ordinary skill in the art, variations and 
modifications of each of the disclosed embodiments, including combinations thereof; can 
be made within the scope of this invention as defined by the following claims. 
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CLAIMS 



What is claimed is: 



1 . A readable medium having instructions, the instructions including instructions 
that cause a processor to perform the steps of: 
detecting a first pressure on a first input device; 
providing a first tactile sensation to the first input device; 
detecting a second pressure on the first input device, the second pressure greater 
than the first pressure; and 

providing a second tactile sensation to the first input device. 



2. The readable medium of claim 1 further comprising stored instructions, the stored 
instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 

detecting a third pressure on the first input device, the third pressure greater than 
the second pressure; and 

providing a third tactile sensation to the first input device. 

« 

3. The readable medium of claim 2 further comprising stored instructions, the stored 
instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 

detecting a fourth pressure on the first input device, the fourth pressure greater 
than the third pressure; and 

providing a fourth tactile sensation to the first input device. 
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The readable medium of claim 1, the first tactile sensation different from the 
second tactile sensation. 



The readable medium of claim 1 further comprising stored instructions, the stored 
instructions including instructions which, when executed by a processor, cause me 
processor to perform the step of: providing the first tactile sensation to a second 
input device. 



5. The readable medium of claim 5 further comprising stored instructions, the stored 
instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of providing the second tactile sensation to the 
second input device. 



7. The readable medium of claim 1 further comprising stored instructions, the stored 
instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 
detecting a third pressure on a second input device; and 
providing a third tactile sensation to the second input device. 



8. The readable medium of claim 7, the third tactile sensation different from the first 



tactile sensation. 
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9. The readable medium of claim 7 further comprising stored instructions, the stored 
instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 

detecting a fourth pressure on the second input device, the fourth pressure greater 
than the third pressure; and 

providing a fourth tactile sensation to the second input device. 

1 0. The readable medium of claim 1 , the first tactile sensation different from the 
second tactile sensation. 

1 1 . The readable medium of claim 10, the first tactile sensation comprising a different 
frequency than the second tactile sensation. 

12. The readable medium of claim 1, the first input device comprising a button on a 
mobile telephone. 

13. The readable medium of claim 1, the first input device comprising a soft-key on a 
touchpad. 

* 

14. The readable medium of claim 2 further comprising stored instructions, the stored 
instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 

r 
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» 

upon detecting the first pressure, providing a first signal indicating a first 
alphanumeric character; 

upon detecting the second pressure, providing a second signal indicating a second 
alphanumeric character; and 

upon detecting the third pressure, providing a third signal indicating a third 
alphanumeric character. 

1 5 . The readable medium of claim 14 further comprising stored instructions, the 

■ 

stored instructions including instructions which, when executed by a processor, 
cause the processor to perform the steps of: : 

upon detecting the first pressure, displaying the first alphanumeric character, 
upon detecting the second pressure, displaying the second alphanumeric 
character, and 

* 

upon detecting the third pressure, displaying the third alphanumeric character. 

1 6. The readable medium of claim 1 , the second pressure on the first input device 
comprising a continuous rise in pressure from the first pressure. 

17. A readable medium having stored instructions, the stored instructions including 
instructions that, when executed by a processor, cause the processor to perform 
the steps of: 

detecting a first pressure on a first input device comprising requesting a function; 
and 
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providing a first tactile sensation to the first input device indicating initiation of 
the Amotion. 



1 8. The readable medium of claim 1 7, the function comprising initiation of a menu. 



19. The readable medium of claim 1 8, the menu comprising a first sub-menu, and the 
readable medium further having stored instructions, the stored instructions 
including instructions which, when executed by a processor, cause the processor 
to perform the step of: 

providing a second tactile sensation indicating initiation of the first sub-menu. 



20. The readable medium of claim 19, the menu comprising a second sub-menu, and 
the readable medium further having stored instructions, the stored instructions 
including instructions which, when executed by a processor, cause the processor 

* 

to perform the step of; 

providing a third tactile sensation indicating initiation of the second sub-menu. 



21 . The readable medium of claim 19, the first tactile sensation different than the 
second tactile sensation. 

1 

22. The readable medium of claim 21, the second tactile sensation different than the 
third tactile sensation. 
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23 . The readable medium of claim 1 7, the function comprising an operation mode. 



24. The readable medium of claim 23, the operation mode comprising at least one of 
the following: 

instant messaging, electronic mail, voice mail, game, and missed calls. 



25. The readable medium of claim 17, the first tactile sensation indicating a structure 



of the menu. 



26. The readable medium of claim 25, the menu comprising at least one sub-menu. 



27. The readable medium of claim 26, the first tactile sensation further indicating the 
number of sub-menus comprising the menu. 



28. A readable medium having stored instructions, the stored instructions including 
instructions that, when executed by a processor, cause the processor to perform 
the steps of: 

detecting a first pressure at a first location on a touchpad; 

upon detecting the first pressure, providing a first tactile sensation to the 

touchpad; 

detecting a second pressure at a second location on a touchpad; 
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upon detecting the second pressure, providing a second tactile sensation to the 
touchpad, the first tactile sensation having a different magnitude than the second 
tactile sensation. 



29. The readable medium of claim 28, the first tactile sensation further having a 
different wave form than the second tactile sensation. 



30. The readable medium of claim 28, the first tactile sensation further having a 
different frequency than the second tactile sensation. 



3 1 . The readable medium of claim 28 having stored instructions, the stored 

instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 

detecting a third pressure on the touchpad comprising requesting a function; 
determining that the function is unavailable; and 
upon determining that the function is unavailable, providing a third tactile 
sensation to the touchpad. 



32. The readable medium of claim 28 having stored instructions, the stored 

instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 
detecting a third pressure on the touchpad; 

■ 

deteniiiaing that the third pressure comprises an ambiguous input; 
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I 



upon deterarining that the third pressure comprises the ambiguous input, 
providing a third tactile sensation to the touchpad. 



33 . A readable medium having stored instructions, the stored instructions including 
instructions that, when executed by a processor, cause the processor to perform 



the steps of: 

detecting a first pressure at a first location on a touchpad; 

upon detecting the first pressure, providing a first tactile sensation to the 

touchpad; 

detecting a second pressure at a second location on a touchpad; 
upon detecting the second pressure, providing a second tactile sensation to the 
touchpad, the first tactile sensation having a different wave form than the second 
tactile sensation. 



34. The readable medium of claim 33, the first tactile sensation further having a 
different magnitude than the second tactile sensation. 



35. The readable medium of claim 33, the first tactile sensation further having a 
different frequency than the second tactile sensation. 



36. The readable medium of claim 33 having stored instructions, the stored 

i 

instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 



48 



WO 03/038800 PCT/US02/35016 

detecting a third pressure on the touchpad comprising requesting a function; 
determining that the function is unavailable; and 
upon determining that the function is unavailable, providing a third tactile 
sensation to the touchpad. 



37. The readable medium of claim 33 having stored instructions, the stored 
instructions including instructions which, when executed by a processor, cause the 
processor to perform the steps of: 

detecting a third pressure on the touchpad; 
determining that the third pressure comprises an ambiguous input; 
upon determining that the third pressure comprises the ambiguous input, 
providing a third tactile sensation to the touchpad 

■ 

38. A readable medium having stored instructions, the stored instructions including 
instructions which, when executed by a processor, cause the processor to perform 
the steps of: 

detecting a first pressure on a first input device comprising requesting a function; 
determining that the function is unavailable; and 
upon determining that the function is unavailable, providing a first tactile 
sensation to the firstinput device. 
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39. The readable medium of claim 38 having stored instructions, the stored 

instructions including instructions which, when executed by a processor, cause the 
processoi^to perform the steps of: 
determining that the function is available; and 

upon deterniining that the function is available, providing a second tactile 
sensation to the first input device, the second tactile sensation different from the 
first tactile sensation. 



40. The readable medium of claim 39, the second tactile sensation comprising a 
different frequency than the first haptic feedback. 



41. A readable medium having stored instructions; the stored instructions including 
instructions that, when executed by a processor, cause the processor to perform 
the steps of: 

detecting a first pressure on a first input device; 

determining that the first pressure comprises an ambiguous input; 

upon deterniining that the first pressure comprises the ambiguous input, providing 

a first tactile sensation to the first input device. 



42. The readable medium of claim 41, wherein determining that the first pressure 

comprises an ambiguous input further comprises detecting a second pressure on a 
second input device. 
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43. The readable medium of claim 42, wherein determining that the first pressure 
comprises an ambiguous input further comprises detecting the first pressure on 
the first input device approximately simultaneous to the second pressure on the 
second input device. 

44. The readable medium of claim 1, wherein determining the first pressure on the 
first input device comprises receiving a first input signal, 

* 

45. The readable medium of claim 1, wherein providing the first tactile sensation to 
the first input device comprises transmitting a first controller output signal to an 
actuator in communication with the first input device. 

46. An input device, comprising: 

a means for determining pressure; and 

an actuator in communication with the means for determining pressure and 
capable of creating at least three distinct tactile sensations in response to at least 
three corresponding pressure input signals from the means for determining 
pressure. 

47. The input device of claim 46, wherein one of the at least three corresponding 
pressure input signals indicates a rest state. 
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71. The apparatus of claim 66, the touchpad comprising a pressure calculator to 



measure the distinct amount of pressure. 



72 . The apparatus of claim 66, further comprising: 

an object to select one of the buttons by pressing a location of the display panel 
corresponding to that button; and 

a pressure calculator to calculate the distinct amount of pressure based upon 



an 



amount of area of the object in contact with the display panel. 



73. The apparatus of claim 66, the apparatus comprising at least one of a mobile 
telephone, a personal computer and a hand-held computing device. 



74. An apparatus comprising: 

a plurality of input devices to communicate a plurality of input signals to an 
electronic device, each input device corresponding to one of the input signals and 
each input device having multiple positions; 

at least one actuator in communication with the plurality of input devices to 
output a plurality of distinct tactile sensations to all of the input devices; and 
at least one controller in communication with the input devices to receive the 



input signals and to detect the position of each input device and in communication 
with the actuator to produce tactile sensations corresponding to the received input 
signals. 



56 



«■ 



WO 03/038800 PCT/US02/35016 



75. The apparatus of claim 74, the actuator capable of varying the magnitude of 
produced tactile sensation in accordance with the detected position of the input 
device associated with the received input signal. 



76. The apparatus of claim 74, the actuator capable of producing a distinct tactile 
sensation corresponding to both the received input signal and the detected 
position of the associated input device. 



77. The apparatus of claim 74, each input device associated with the selection of at 
least one function of the apparatus, and the actuator further produces a function 
failure notification tactile sensation upon receipit of a input signal associated with 
the function and notification of failure of that function. 



78. A mobile phone comprising the apparatus of claim 74. 

79. The mobile phone of claim 78, comprising a keypad comprising the plurality of 
input devices. 

80. The mobile phone of claim 78, the at least one actuator comprising a plurality of 
actuators, each actuator coupled to a separate input device. 

8 1 . The mobile phone of claim 78, comprising select keys associated with function 
input signals to activate a predetermined mobile phone function, the actuator to 
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produce the tactile sensation associated with each mobile phone function upon 
receipt of the associated function input signal. 



82. The mobile phone of claim 81, the actuator to produce a function failure 
notification tactile sensation upon receipt of a function input signal and 
notification of failure of that function. 
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